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(57) ABSTRACT 

A system and method for selecting and inserting advertise- 
ments into a video programming feed at the household level. 
An advertisement insertion device in a home entertainment 
system receives a plurality of advertisements from an adver- 
tisement source. The advertisement insertion device selects 
one of the advertisements for display to a viewer according 
to advertisement selection criteria combined with viewer 
and system information. The video programming is dis- 
played to a viewer while the advertisement insertion device 
monitors the programming feed for a triggering event indi- 
cating an appropriate time to display the selected advertise- 
ment. At the appropriate time, the video programming feed 
is interrupted and the selected advertisement is displayed. 
Selecting advertisements at the household level allows 
advertisers to target viewers with a high degree of specific- 
ity. In particular, the advertisement selection criteria may 
take into account, for example, demographic data relating to 
the household, the geographical location of the household, 
of individual viewing habits. The method optionally 
includes monitoring and reporting viewer response to the 
selected advertisements. 

23 Claims, 7 Drawing Sheets 
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FIG, 1 
(PRIOR ART) 
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FIG. 2A 

(PRIOR ART) 




FIG. 2B 

(PRIOR ART) 
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TECHNIQUES FOR INTELLIGENT VIDEO merit and services for distributing the programming of 

AD INSERTION national broadcaster 18 to a local or regional area. In 

compensation for broadcasting the programming, national 
broadcaster 18 allows local affiliates 22 and 24 to sell and 

BACKGROUND OF THE INVENTION 5 broadcast local advertisements 26 and 28. In this example, 

it is to be understood that local affiliate 22 serves a different 

1. Hie Field of the Invention geographical region than local affiliate 24. Accordingly, 
The present invention relates to displaying advertisements many of the advertisements 26 broadcast by local affiliate 22 

to viewers of video programming. In particular, the present are likely to be different than the advertisements 28 broad- 
invention is directed to methods and systems for selecting 10 cast by local affiliate 24. Such geographical differentiation of 
and inserting advertisements into a video programming feed advertisements is often of great interest to advertisers. Local 
at the household level. advertisers may find it cost-effective to purchase advertising 

2. The Prior State of the Art timc from local 22 or 24 in order 10 specifically 
A - - . , , . . target local viewers, while it would be impractical to pur- 
A major source of revenue for commercial television u , ^ ' nn r *• , j- f u ** i 

. , \ . , 4 t . „ . 1t chase an advertisement 20 for national distnbution. In this 

broadcasters is the sale of broadcast time to advertisers. 15 , , , ... , . t , 

AJ t . . r . „ t conventional approach to selhng advertisement time, the 

Advertisine is the main source of income for national , . . , . , . , , ' , „ 

, , . . ° , 4 , , i , ! . contractual arrangement between national broadcaster 18 

television broadcasters and their local over-the-air affiliates, . , i «=r * m a ~>a j- i * -i 

r . . ! , i j • * * c_ an" local affiliates 22 and 24 ordinarily attempt to strike a 

Likewise, cable networks derive their income from a com- u , , . , . , ' r , - e , 

.... ' - t c j • *• j.u • * * balance between local advertisements 26 and 28 and 

bination of the sale of advertising tune and the receipt of , « . . , . . „ 

u • »■ f a ■ _j * • i j- on national advertisements 20 in order to maximize overall 

cable subscription fees. Advertising revenue is a leading 20 . 

f * - *u .i *i vi j- i c advertising income. 

factor in the currently available diverse selection of com- A . . P t . . . , , 

mercial television programming. . ™P°«™t of me television broadcast 

. , . . • « i ... industry involves cable networks 30, which are generally not 

Advertisers have typically attempted to maximize the ^ ^ local .^.^ Instead> cabk nctwolks 30 

return on their advertising investment by targeting specific distribut6 thcir programmillg to cable providers 32 by means 

viewer segments that are likely to be most receptive to the 25 of satelJite or other communication systems. Cable networks 

commercial message embodied m the advertisements. One 30 ^ advertising tine to national advertisers generally in 

ol the most widespread and simplest ways of targeting a similar 

manner as national broadcaster 18. Accordingly, 

viewers involves identifying what types of viewers are me t ica] ^vertisement 34 broadcast by cable network 30 

associated with specific television programs. For example, it fe t d tQ ^ national yiewin aildieQce . M a finailcial 

may be found that sports programming is viewed by a to cable Mers 32 to make the 

segment of the population that includes a disproportionate pr0 g rammmg of cahlc network 30 available t0 cable sub _ 

number of persons who are likely to purchase automobiles. scribers (Lc household 16)> cable network 30 oflen ^ 

In another example, it may be found that newsprograms are nates selected time s]ots ^ be ^ to local adverlisers 

viewed most frequenUy by persons who are more interested b me cable ^ ^ man caMe idQTS msert 

m investment services than the public at large. local advertisements 36 ^to the programming of cable 

Advertisers offering goods or services that coincide with networks 30. 

the interests of the viewers of a particular program are Frequently, the geographical area served by a cable pro- 

usually willing to pay a premium for advertising time vidcr 32 ^ significantly smaller than the geographical area 

associated with the program. Accordingly, broadcasters have ^ servcd by a local 2 2 or 24. Accordingly, the adver- 

a financial incentive to provide programming that is easily tisements 36 distributed by cable provider 32 may be 

associated with specific segments of the viewing population targeted to relatively small geographically areas, such as a 

and to facilitate the identification of the profiles of viewers. specific city 

Another method of targeting specific viewing audiences The effects of the conventional distribution of advertising 
involves selecting advertisements according to the geo- 45 tj me between local and national advertisers may be more 
graphical region in which they are to be broadcast. fully understood by considering the system of FIG. 1 from 
Frequently, viewers in one local or regional area may be me standpoint of viewers in households 12, 14, and 16. In 
more likely to be receptive to an advertiser's message than this example, it is assumed that household 12 is in a first 
viewers in a different area. For example, some advertise- geographical region served by local affiliate 22 while house- 
ments are presented by businesses operating in a limited 50 holds 14 and 16 are in a second geographical region served 
geographical area. Accordingly, advertising success and the by local affiliate 24. Furthermore, household 16 is in a 
advertising revenues received by broadcasters are maxi- specific city served by cable provider 32 within the second 
mized when different advertisements may be broadcast to geographical region. In this example, a viewer in household 
different geographical areas. ^ receives advertisements 20 from national broadcaster 18 
FIG. 1 illustrates a conventional example of a system for 55 and advertisements 26 from local affiliate 22. Household 14 
selectively broadcasting different advertisements to house- receives the same advertisements 20 from national broad- 
holds in different geographical regions. A typical broadcast- caster 18 but receives advertisements 28 that are specifically 
ing system includes content providers 10 that distribute targeted to the second geographical region served by local 
television prograrnming to households 12, 14, and 16. In this affiliate 24. Household 16 also receives advertisements 20 
example, content providers 10 include a national broadcaster 60 from national broadcaster 18 and advertisements 28 from 
18, which is one of the national television broadcasting local affiliate 24. In addition, household 16 receives national 
networks. Each national broadcaster 18 typically provides advertisements 34 from cable network 30 and local adver- 
programming, including advertisements 20, to a plurality of tisements 36 from cable provider 32. 
local affiliates 22, 24, and others scattered across the coun- FIG. 2A illustrates a conventional system whereby a local 
fry- 65 affiliate inserts local advertisements into a video program- 
Local affiliates 22 and 24 contractually agree with ming feed received from a national broadcaster. In FIG. 2A, 
national broadcaster 18 to provide the broadcasting equip- a series of advertisements 20 arc included at a predetermined 
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time in programming feed 38 by the national broadcaster 18 provide a system for delivering and displaying advertise- 
of FIG. 1. According to the contractual agreement between ments wherein the response of the viewers may be accu- 
the national broadcaster 18 and local affiliate 24, the national rately measured, 
broadcaster includes in the programming feed 38 an occa- 
sional time slot 40 that is filled by local advertisements 28 5 SUMMARY AND OBJECTS OF THE 
sold to advertisers by the local affiliate. INVENTION 

FIG. 2B illustrates a conventional system whereby a cable „_ 4 . • j. „ j , ^ ■> , 

provider inserts local advertisements into a video program- , ^ present invention is directed to methods and systems 

ming feed received from a national broadcaster In this for in f ^ advertisements or other video or visually dis- 

example, cable network 30 broadcasts a series of advertise- 10 ^ cd ob J e ^f mto Pipgmnnn^ feeds at the house- 

ments 34 at a predetermined time in its programming feed Dold lcv ^ The method of invention allows advertisers to 

39. According to the contractual agreement between the target mdividual viewers based on the needs and interests of 

cable provider 32 and the cable network 30, the cable ^dividual viewers and households. Advertisement selection 

provider is given the option of inserting advertisements 36 a < ^ household level greatly increases the 

into specified time slots 42 in programming feed 39. 15 efficiency of television advertising. 

Because cable providers ordinarily broadcast a large number According to one aspect of the method of the invention, 

of channels, many cable providers are unable to sell all the * conventional video programming feed is displayed to a 

advertising time that is made available by the cable net- viewer. Either before or during the display of the video 

works. For this reason, cable networks typically broadcast a programming feed to the viewer, a plurality of advertise- 

national advertisement 34 during the specified time slots 42 ^ ments from an advertisement source are received by a home 

in recognition that the cable provider may not insert an entertainment system in the household. The received adver- 

advertisement 36. tisements are either stored in an advertisement repository for ( 

The foregoing systems have been used profitably by later display or are made available to the home entertain- 
advertisers and the television broadcast industry. Advertis- ment system at an appropriate time for immediate display, 
ing revenues are largely responsible for the wide range of 25 At least some identifying characteristics of the viewer, the 
television choices currendy available to the viewing public. content of the video programming, the geographical location 
However, even with the widespread practice of targeting of the household, or other factors, are compiled and are used 
viewers based on television programming content and the in combination with designated ad selection criteria in order 
practice of geographically differentiating advertisements, to select for display an appropriate advertisement The 
viewers who are likely to be disinterested in the goods or 30 selected advertisement is appropriate in the sense that it is 
services offered by advertisers unavoidably constitute a specifically associated with characteristics of the viewer or 
large percentage of the viewing population. For example, the household. Many of the criteria for selecting appropriate 
even though it may be found that viewers of sports pro- advertisements allow targeting of segments of the viewing 
gramming are collectively more likely to purchase population in ways that are more efficient and reliable than 
automobiles, a large number of individual viewers in this 35 have been possible before the invention, 
segment of the viewing population simply are not interested During display of the video programming feed, an appro- 
in such purchases. Likewise, while viewers of news pro- priate time for displaying a selected advertisement to the 
grams may be more interested as a whole in investment viewer is indicated by a triggering event. Typically, the 
services than the general public, a large number of such appropriate time coincides with advertisements that are 
viewers belong to age or economic segments of the popu- 40 originally carried on the video programming feed. The 
lation that traditionally do not make use of investment triggering event may be a signal carried in the video pro- 
services. In view of these and many other examples, con- gramming feed, implied by the timewise structure by the 
ventional methods and systems for targeting advertisements video programming feed, or based on an external 
to specific groups of viewers are inefficient. mechanism, such as information contained in an electronic 

Conventional systems for delivering advertisements to 45 program guide. At the appropriate time indicated by the 

viewers fail to provide accurate feedback mechanisms for triggering event, the video programming feed is interrupted 

gauging viewer response. As seen in FIG. 1, delivery and and the selected advertisement is displayed to the viewer 

display of advertisements of advertisements in households using a display screen of the home entertainment system. In 

12, 14, and 16 is essentially one-way communication from effect, the advertisement originally carried on the video 

the advertiser to the viewer. The advertiser is generally 50 programming feed is overwritten with the selected adver- 

unable to determine whether its advertisements have reached tisement. Upon termination of the advertisement, the video 

the desired segment of the viewing population or whether programming feed is again displayed to the viewer, 

they have been effective. At most, advertisers are able to According to one embodiment of the invention, the 

monitor business activity before and after a particular adver- method includes monitoring the response of the viewer to 

using campaign or to initiate a direct survey to learn of 55 the selected advertisement. For example, information relat- 

viewers* perceptions of advertisements. Such approaches ing to the viewer response may be stored in the home 

are likely to be expensive and inconclusive. entertainment system and may be periodically transmitted to 

In view of the foregoing, it can be understood that there a clearinghouse, where the information is made available to 

is a need in the art for systems and methods for more the advertisers, the operator of the advertising source, or 

specifically targeting viewers in order to tailor advertise- 60 other interested parties. Thus, the invention allows poten- 

ments to the interests and needs of the viewers. Because of dally valuable viewer feedback to be compiled. The viewer 

the financial incentives involved, both content providers and response information may allow the advertisers to further 

advertisers would be interested in improved systems for modify the content of their advertisements or to change the 

directing television advertisements to interested viewers. A advertisement selection criteria so as to communicate more 

system for selecting advertisements at a more local level 65 effectively to viewers. This can be done by extending the 

than has previously been possible would be a great advance- system to include an automatic feedback loop that selects 

ment in the art. Furthermore, it would be advantageous to ads based on rules set by the advertiser. 



08/06/2004, EAST Version: 1.4.1 



US 6,698,020 Bl 

5 6 

The invention allows advertisements to be more effi- DETAILED DESCRIPTION OF THE 

ciently tailored to the needs and interests of individual PREFERRED EMBODIMENTS 

viewers than has been previously possible. The advertiser « 4 . w . f « < j £ 

t - - t_ • • • The present invention relates to methods and systems for 

realizes benefit, from toe invention by mimmizing the and kt0 a video m . 

effectiveness of ite efforts of targeting interested viewers 5 m ^ &t ^ bm ^ bM level . ^ advertiseme J nts B to be 

The invention allows the operator of the advertisement ^ to a yiewer accordin to ^ iQveDtion are se , ected 

source and/or the content providers to increase advertising . . . , A ■« • • u* .* ■ * 

„ 5 - .... j ^. • accordmg to designated cntena in combination with lnfor- 

revenue and to more effectively compete in the advertising . . , . * ♦ e.u -j 

. j . • ' « 4 * mation that characterizes the viewer, the content of the video 

market because advertisers are generally willing to pay for . ? A V. , , f 

. . A . J- . r^- ii programming feed, the geographical location of the 

the increased advertisement targeting efficiency. Finally, the 10 f . ° . V1 . J * « ■ *i « * * 

. . ... . , . . 1 ' household, or the like in order to efficiently target segments 

viewing public benefits by bemg exposed to consumer r Tr - „ T - - 

. - .... i . . • 1 j . , . or the viewing population. 

information that is more relevant to their needs and interests _ I , . - , ^ 

than has been possible under conventional advertising sys- t Fot P 111 * 05 ? 5 of ^vemence, the invention is described 

tcms herein by making primary reference to insertion of adver- 

' . . ... . .Hilt tisements into a video programming stream. However, the 

/^^^J^^^Wofthei^lKmwmta w yideo iMert j 0n methods Qf ^ we ^ 

set forth m the description which follows and in part will be alicable t0 other forms of video mrAmt or video objec(s 

obvious from the description or may be learned by the b d advertisements . For L the video ^ 

practice of the invention. The objects and advantages of the m ^ ^ woM otflerwise fee ^ to a ^ 

mvention may be realized and obtained by means of the i 1 a -*l *. c -a • 

7 , ... . , , . , , selectivity replaced with any type of video programming, 

instnimente andcombina^ 20 ^ ^ subscription, special-interest televi- 

appended claims. These and other objects and features of the sioQ ^ of ^ ^ ^ tem objects „ extends 

present mvenuon will become more fully apparent from the tQ advertisements and a other form of video 

following description and appended claims or may be gramming , inchlding ^ totegoiag specifically listed 

learned by the practice of the mvention as set forth herein- ^ (ypes of ^ programmmg . ^ ^ m ^ ^ 

a er * recognize, upon learning of the disclosure herein, that the 

BRIEF DESCRIPTION OF THE DRAWINGS methods of inserting selected advertisements extend to 

insertion of any other type of desired video programming, 

In order that the manner in which the above-recited and video content, or video objects, 

other advantages and objects of the invention are obtained, 3Q M ^ cd nerein> me term "household" refers to a house or 

a more particular description of the invention briefly any other site where video programming and advertisements 

described above will be rendered by reference to specific m displayed. Personal residences and businesses where 

embodiments thereof which are illustrated in the appended television programming is made available to patrons are 

drawings. Understanding that these drawings depict only intended to be included under the term household. The term 

typical embodiments of the invention and are not therefore 35 "household" also encompasses the viewers in a house or 

to be considered limiting of its scope, the mvention will be other sitc , the home entertainment system used to display the 

described and explained with additional specificity and video programming and the advertisements, and the content 

detail through the use of the accompanying drawings m of mc vidco programming displayed at the house or other 

which: site 

FIG. 1 is a schematic diagram of a broadcasting system of ^ As used herein, the term "home entertainment system" 

the prior art wherein advertisements are selected and broad- includes any television or other display screen and the 

cast to viewers of different geographical regions. associated hardware and software for displaying the video 

FIG. 2A is a schematic diagram of the insertion of programming and selected advertisements according to the 

advertisements into a video programming feed by a local invention. As further specified herein, some home entertain- 

af&liate of a national broadcaster as practiced in the prior art. 45 ment systems of the invention have other features, such as 

FIG. 2B is a schematic diagram of the insertion of video programming recording capabilities or access to the 

advertisements into a video programming feed by a cable Internet and the World Wide Web. 

provider as practiced in the prior art. Embodiments within the scope of the present invention 

FIG. 3 is a schematic diagram of a system of inserting include computer-readable media having computer- 
advertisements into a video programming feed at the house- 50 executable instructions or data fields stored thereon. The 
hold level according to the invention. computer-executable instructions may include program code 

FIG. 4 is a schematic diagram illustrating a system for means for executin g selected steps of the methods disclosed 

receiving advertisements from an advertising source and herein - ^ computer-readable media can be any available 

video programming from a programming source according media which can be accessed b V a g eneral P ur P<>se ™ special 

to the invention. 55 P^ 056 computer. By way of example, and not limitation, 

- . * ..j. j • vr • , j i. '1 such computer readable media can comprise RAM, ROM, 

WG. 5 is a schematic diagram depicting in greater detail rmnm/pn n m/ ,i_ 1 j- 1 . 

, , • j- j • EEPROM, CD-ROM or other optical disk storage, magnetic 

an advertisement insertion device 01 the mvention. j. , . t . \ , . & ' ■ 

„ . , , „ disk storage or other magnetic storage devices, or any other 

FIG 6 is a flow diagram showing selected steps of a me dium which can be used to store the desired executable 

Drthodofsefecti^ 60 ^0^^ or ^ fields ^ which can accessed b a 

advertisement insertion device of FIG. 5. general purpose 0f special purpose computer. Combinations 

FIG. 7 is a schematic diagram illustrating a satellite 0 f the above should also be included within the scope of 

system for broadcasting advertisements to a household, computer readable media. Executable instructions comprise, 

where a selected advertisement is displayed according to the for example, instructions and data which cause a general 

mvention. 65 purpose computer, special purpose computer, or special 

FIG. 8 is a schematic diagram of a system for embedding purpose processing device to perform a certain function or 

Internet links in a television broadcast. group of functions. 
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FIG. 3 is a high-level diagram of an advertisement~ins£rt; v> FIG. 4 illustrates in greater detail the sources of adver- 

tion system according to the invention. One or more content^ tisements and video programming according to one embodi- 

providers 50 broadcast or otherwise distribute a video pro- j ment of the invention. For example, advertisement source 62 

gramming feed 52. The content providers 50 may include \ m ay be a local repository having stored therein a plurality of 

one or more of the content providers 10 shown in FIG. 1. In 5 advertisements, from which an advertisement stream 64 is 
particular, video programming feed 52 may be provided by / delivered to the ad insertion device over an advertisement or 

a national broadcaster, a local affiliate, a cable network, other vidco cnanracl> According to another example, adver- 

satellite broadcast networks, or any other source of video sourcc 62 mdlldes a repos itory at a central location 

programming Other examples of content providers are loca* tQ ^ m ^ households . Alternatively, advertisement 

independent television stations, commum y P^eb pay, 1Q ^ 62 bc a just -in-time system for delivering 

per-view channels, and videotape or any other medium 1 . ' A . 4t _ , . * , . ^ 

• r«^A~A .T • J ~ advertisement stream 64 to the ad insertion device. 

carrying recorded video progranimrng. 

In one embodiment of the invention, the content provider ^ of a number of entities may be the advertisement 

50 broadcasts advertisements 54 that are included in the content provider or, in other words, the party responsible for 

video programming feed 52. Advertisements 54 may be of making the advertisements available to advertisement 

interest nationally or locally as described above in reference 15 source 62 and ad insertion device 60. In one embodiment, 

to the advertisements of FIG. 1. Video programming feed 52 the advertisement content provider is the advertiser, 

is transmitted to household 56 via any suitable program Alternatively, the advertisement content provider is the same 

delivery channel, such as an over-the-air broadcast, a cable as the video programming content provider. For example, 

provider, a consumer satellite service, telephone lines, via the national broadcaster 20 of FIG. 1 may deliver advertise- 

the Internet, or by any other system for transmitting video 20 ments to individual households for local selection and 

data. Any of the foregoing structures or systems are display to viewers according to the invention disclosed 

examples of means for delivering a video programming feed herein. In another embodiment, a third party advertisement 

to the display device. When a viewer desires to watch the prov ider makes the advertisements available to the 

video programming carried by feed 52, the video program- advertisement source 62 and the ad insertion device 60. In 

ming is displayed using display device 58. ^ ^ case? ^ ^ party advertisement ^nt provider 

At an appropriate time specified by encoded data m video typically contracts with the advertisers to provide a pre- 
programming feed 52 or by the structure of video program- termined t of number of advertisemeDt exposures for the 
ming feed 52, the household advertisement insertion device advertisers 
60 interrupts the display of the video programming feed 52. * . 

An advertisement 59 that has been selected according to any 30 described above in reference to FIG. 3, a programming 

desired method is then displayed to the viewer using display sourcc 66 > ™ hich m ^ be °P eratcd b ? content P rovlder 50 > 

device 58. Preferably, the criteria by which advertisement 59 su PP hes ^ de ? Programming feed 52 to the advertisement 

is selected result in efficient targeting of advertisement 59 to msertion dcvicc . 60 * A swltch 68 between 

an individual viewer. The source of the selected advertise- yi ? co programming feed 52 and selected advertisements of 

ment and the criteria used to select the advertisement are 35 advertisement stream 64 -and transmits the selected data feed 

described in greater detail below. 10 dls P la y device Video switch 68 ma y be actuated at m 

Examples of the structure and functions of household a PP ro P riate time indicated by a triggering event delivered by 

advertisement insertion device 60 are also described in advertisement trigger source 70. 

greater detail below. In one embodiment of the invention, the According to one aspect of the invention, the triggering 

ad insertion device is embodied in a special purpose com- 40 event fe a designated signal encoded in video programming 

puter located at the household where the selected advertise- feed 52 * Alternatively, however, the triggering event may be 

ments are displayed. In a particular embodiment of the implied by some mechanism, such as the conventional 

invention, the special purpose computer embodying the ad pattern of advertisements in video programming feed 52. 

insertion device 60 is a home entertainment system compo- an implied triggering event is used to initiate display 

nent known as a WebTV box available from WebTV 45 of the selected advertisement, any consistent pattern in video 

Networks, Inc. of Palo Alto, Calif . In particular, the WebTV programming feed 52 that is associated with forthcoming 

box may be adapted to perform the finctions described advertisements may be used as the implied triggering event, 

herein for selecting and displaying advertisements at the For example, programming sources 66 such as national 

household level. broadcasters or cable networks often transmit a very brief 

In other embodiments of the invention, the ad insertion so black innately preceding the onset of a series of 

device 60 may be integrated in a television set that also advertisements. Such a pattern may be interpreted by ad 

includes display device 58. Other examples of suitable ad insertion device 60 and video switch 68 to be a triggering 

insertion devices 60 may have some components thereof at cycni gating an appropriate time to insert a selected 

household 56 and other components at a remote location. advertisement. 

For instance, advertisements selected on a household-by- ss A predetermined agreement between third party ad source 

household basis may be distributed by a cable provider using 62 and programming source 66 may be used to ensure that 

conventional cable television infrastructure. The cable pro- actual triggering events are provided to the ad insertion 

vider may compile household data relating to several house- device 60. In this case, both the third party ad source 62 and 

holds at a central or regional location, where advertisements programming source 66 may benefit from the ability to 

to be displayed to viewers in the various households are 60 specifically target viewers. In contrast, the use of implied 

selected. According to further examples, selection of an triggers or other actual triggering events may be accompa- 

appropriate advertisements for a particular household may nied with unilateral insertion of selected advertisements into 

be conducted at a remote location, with the selected adver- the video programming feed 52 on the part of the ad source 

tisement being transmitted to the household at the appropri- 62. 

ate time by multiplexing multiple video streams or by use of 65 In any of the above -described scenarios, the operator of ad 

a conventional telephone network or another communica- source 62 is able to sell advertising opportunities to adver- 

tions infrastructure. tisers or to deliver its own advertisements. It can be under- 
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stood that an operator of an advertisement source 62 is able computer-executable instructions for deriving or making a 

to sell advertising time and deliver advertisements to view- best estimate of the identity of the viewer based on current 

ers with or without the participation of the operator of and past viewing habits. 

programming source 66 or other content providers. BecalJse one imptanBntatiDn utilizes a WebTV box, a 

However c»operaUon between the operator ot programming 5 mechanism 

to transmit viewer response information from 

source 66 and the operator of ad source 62 may result in .u j • j • • jj i_ i_ 

, j . * . -v 4 . v •* the ad insertion device is provided, such as phone lines, 

several advantages, such as the ability to use explicit trigger , . . A ' *., , r ^ 3 

signals rather than implied trigger signals. c f b1 ^ modems ; Intemet or World Web "nnedions, 

t , j • , Z- * j 1- j r j etc. For example, viewer response statistics may be collected 

In one embodiment, the advertisements delivered from ad „. r „, . \ ... ' - 

£ - . , j i #• . j** - 11 on a World Wide Web site, compiled, sent, or made 

source 62 are inexpensively converted from traditionally in .... .. t . ■ A . . 7 , 

* j j- c i * * i * • *, 10 available, all automatically, using existing technology or 

non-video media. For example, text, graphics, pictures, or ... , ' . . T ■ i 7 • j 

i • r . /j j * /• r ™ 4r with little user intervention. In implementations using ad 

audio from a computer generated document (i.e., an HTML . j ... . . «f . . ,,7.^,. iL 

x . . j * * * j ... \ r insertion devices that are not embodied in a WebTV box, the 

page) is converted into a video display such as a freeze- JA . , c . , 

c ,., , ™. 4 l j • 11 data channel for sending viewer response statistics may also 

trame or shde show. This method is particularly useful for . , . , . . * , r T A . ' . , . 

1 j j • 4 * • i? j mclude phone lines, cable modems, or Internet or World 

community^cale advertisements originating from adverts- 15 w r , ' ' 

,1 . > j >i* n v . i j j 1 1 • • Wiue Weo connections, 
ers that traditionally have not had access to television or 

advertising production resources for economic or other FIG 5 mrther illustrates the components and operation of 

reasons. To illustrate, a school could transmit and display m ad insertion device according to the invention. In 

computer-generated text to viewers within the school bound- particular, FIG. 5 illustrates an embodiment of the invention 

aries in order to inform parents of school events or policies. M wherein a plurality of advertisements are periodically deliv- 

FIG. 4 further illustrates an optional aspect of the inven- ered to me ad m f crtion dc ™ c f d arc stored mercin *» 

tion whereby viewer responses to the selected advertise- Potion for selection and display of one or more of the 

ments are compiled and periodically reported. In this advertisements. Ad insertion device 80 may advantageously 

embodiment, the ad insertion device 60 monitors actions of be a WebT Y bo f having been adapted to include the 

the viewer before, during or after display of the selected « structurc P erfonn mc factions described herein. Ad 

advertisement. Examples of such actions include channel msertl0n dcvicc 80 mcludes mcans for storin S household 

changes during display of the selected advertisement, data > whlch ma y mclude and svstcm information, 

requests by the viewer for additional information, feedback 0ne cxam P le of means for stonng household data is a 

providedbytheviewerinresponsetotheadvertisement,and stora S e locatlon 82 shown m FIG 5 * Stora £ c location 82 

me like. In a further example, the user may be presented with 30 may comprise any computer-readable medium for stonng 

multiple ads and asked to select one for viewing. Informa- data fields hereon The viewer and system information of 

tion about which ad has been selected may also be compiled. t io ™& ° catlon , 82 ma y mchlde "V of a ™& ran S c of 

Such interaction between the viewer of the advertisement ^hold data for ^characterizing the viewer, the geographi- 

and the home entertainment system allows advertisers to cal locaUon of thc household, the features of the ad insertion 

more effectively target interested viewers or to test a pro- 35 device md me home entertainment system, and the like, 

posed advertisement on a limited segment of the viewing ^ viewer and system information may include data 

population while receiving valuable feedback relating to the provided by the viewer upon initiation of the services 

popularity or effectiveness of the advertisement. provided by the ad insertion device 80, such as a voluntary 

When the optional viewer response monitoring feature is survey or questionnaire filled out during the registration 

employed, the systems of the invention include means for 40 ? mc&ss ' During ongoing operation of the ad insertion device 

collecting information relating to actions of the viewer in 80 > ^ viewer ^ system information may be updated 

response to the displayed advertisement. For example, automatically in order to characterize the viewing habits of 

viewer response information is collected in a statistics me hewers. It will be understood that as more detailed 

collection location 61, which may be located at the home information relating to the viewer and the other factors 

entertainment system or at a remote site. According to one 45 disclosed herein is accumulated, the appropriate advertise- 

option, viewer response information is compiled and stored ments to be displayed on display device 58 may be more 

at a statistics collection location 61 that is located within the effectively identified. 

household. The viewer response information may be peri- Specific examples of the viewer and system information 

odically sent to a clearinghouse where the information may stored in storage location 82 include the following. Viewer 

be aggregated and made available to the operator of the 50 demographic data may be stored in storage location 82, 

advertisement source 62, the advertisers, or other interested including age, sex, income, preferred language, number of 

parties. In addition, or in the alternative, the viewer response residents, or similar information. Such demographic infor- 

information remains at the ad insertion device to further mation may be provided directly by the viewer or may be 

modify the advertisement selection process as is described obtained from a third party source and associated with the 

below in greater detail. 55 household using address information. The geographical 

Because many households include more than one viewer, location may also be included and may be specified by city, 

the home entertainment system and the methods of the neighborhood or me street address of the household, and the 

invention optionally include means for identifying the l° ca l time at the household may be monitored. Storage 

viewer. In one example, the means for identifying the viewer location 82 may also store content ratings or parental lock 

includes a login screen or protocol, which requires the 60 codes when the home entertainment system is compatible 

viewer or viewers to identify themselves each time video with such features. The viewer may also be permitted to 

programming is watched. When the invention is incorpo- specify his or her hobbies, interests, spending habits, and 

rated in a Web TV box or another Intemet access system, the anticipated major purchases. 

login structure and protocol may be combined with the According to one implementation, the ad insertion 

system for logging into to Internet access system. In another 65 devices of the invention further comprise means for identi-- 

example, the means for identifying the viewer includes fyingthe content of television programs carried on the video' 

statistics collection location 61 in combination with programming feed. One example of such means is an 
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electronic program database 81 that associates specific tekpj ' according to one of a number of methods. Hie delivery 

vision programs with specific time slots and television channel of the ad selection rules may be the same as the 

channels. Furthermore, electronic program database 81 may^ advertisement delivery channel. For example, ad selection 

include program descriptions associated with the television! rules may be delivered over telephone, over broadcast 

programs listed therein. Electronic program databases hav- \ 5 signals or downloaded from the World Wide Web. 

ing the foregoing features and methods for delivering the Alternatively, the ad selection rules may be delivered to the 

electronic program databases to home entertainment sys- ad insertion device 80 by any available delivery channel 

terns are well known in the art Another example of means mdcpcndc nt from the delivery of the advertisement stream 

for identifying the content of the television programs and the video programming fccd . In aDOther 

includes implementation, preinstalled initial ad selection rules are 

for monitoring the content of the closed captioning signal* • i . j . j • j * j*u • * j 

. . ~ . „ . j t r, ~j j * included in new ad insertion devices and the associated 

that is conventionally broadcast with the video and audio . A 4 . A „ Al _ , . 4 . 

portions of the television program. ho 1 mc entertainment systems. Furthermore, the ad selection 

The viewer and system information may further include ™ les ™? b % automatically modified as more viewer and 

information relating to the viewing habits of the viewers in household information is compded. 

the household. The viewing habits may be described by 15 Advertisement parameters associated with particular 

monitoring the times of day that programming is watched, advertisements are generally assigned by the advertiser, the 

the amount of time spent viewing particular channels, pre- operator of the advertising source 62, or the video program- 

ferred types of programming, etc. In some embodiments, ad ming content provider. In general, the entity that has an 

insertion device 80 is included in a home entertainment incentive for efficient targeting of advertisements to selected 

system component such as a WebTV box that also has 20 segments of the viewing population will likely ensure that 

loternet and World Wide Web browsing capabilities. Moni- appropriate advertising parameters are associated with the 

toring preferred Internet sites may provide useful informa- advertisements. Often, the advertiser or an advertising firm 

tion to be stored in storage location 82 in order to further representing the advertiser will ensure that advertisement 

specify the preferences and background of the viewer. In parameters are attached to the advertisement, 

view of the foregoing, it is to be understood that the types 95 ™ * , ± . . „ , 

of viewer and system information stored in storage location ™ c advertisemen parameters may be conveniently deliv- 

82 may be any desired data that characterizes the viewer, the ™ d 10 ?» * d selection device 80 at the same time as the 

features of the home entertainment system, the content of the advertising feed, using the same delivery channel. While 

video programming feed, the geographical location of the other methods of delivering advertising parameters are 

household, and the like. 30 possible, delivery of the advertisement parameters with the 

Ad selection criteria 83 are stored in ad insertion device associated advertisements provides relatively easy correla- 
80 for use in combination with the viewer and system 11011 between Parameters and the advertisements, 
information 82 and/or the electronic program database 81 in The systems disclosed herein for selecting an appropriate 
order to select appropriate advertisements to be displayed to advertisement for display, including the storage location for 
the viewer. Typical ad selection criteria include both adver- 35 me ad selection criteria 83 and the storage location 82 for the 
tisement parameters associated with particular advertise- viewer and system information, constitute examples of 
ments and ad selection rules. The advertisement parameters means for selecting one of a plurality of advertisements for 
include, for example, a description of the content of the display to a viewer. With respect to many of the following 
advertisement, codes that identify the subject matter of the examples of ad selection criteria, it can be understood that 
advertisement, or other mechanisms for characterizing the 40 a viewe r in a first household is often shown a different 
advertisement so that the advertisement may be displayed to advertisement than a viewer in another home, even though 
an appropriate segment of the viewing population. Accord- the viewers may be watching the same video programming 
ing to one implementation, the ad selection rules are used to feed- 
match the viewer and system information of storage location The following discussion of alternative types of adver- 
82 or the programming content information of electronic 45 tisement selection criteria provides examples of how the 
program database 81 with the advertisement parameters operator of advertisement source 62 and the advertiser may 
associated with the advertisements. In this way, the ad specifically target desired viewers. Based on the program- 
selection criteria 83 may be used to efficiently target desired ming information contained in the electronic program data- 
viewers of particular advertisements. base 81, the ad selection criteria 83 may select specific 

The ad selection rules of ad selection criteria 83 may be 50 advertisements according to a particular program being 
predefined by the advertisers, the video programming con- viewed. TTiis selection criteria is similar to the selection 
tent provider, a third party operator of the advertisement process frequently used in conventional broadcast systems 
source 62, or, in some cases, by the viewer. It can be as described above in reference to FIG. 1. However, accord- 
understood that the source of the ad selection rules may be ing to the invention, an advertiser may specify that its 
determined according to an agreement between the parties. 55 advertisement is to be shown during a particular program 
Alternatively, the methods of the invention disclosed herein regardless of the network on which the program is broadcast, 
may be unilaterally practiced by any one of the foregoing For example, if a syndicated sitcom or other program is 
entities, in which case, the particular entity may exercise broadcast on multiple networks, a selected advertisement 
sole control over the choice of ad selection criteria. The ad may be shown regardless of which network is being viewed, 
selection rules can change over time as more viewer and 60 The programming descriptions contained in the electronic 
system information and viewer response information is program database 81 may be used selected an advertisement 
compiled. In general, the ad selection rules may be desig- according to the subject matter of a particular program. For 
nated in any desired way so as to effectively target indi- example, an advertiser for a current-release motion picture 
viduals that belong to a desired segment of the viewing may request that the ad selection criteria 83 identify all 
population. 65 television programs featuring the cast members of the' 

Hie initial ad selection rules and any updated versions motion picture. Thus, when a star of the motion picture! 

thereof may be delivered to the ad insertion device 80 appears on a television talk show, an advertisement for the, 
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motion picture may be shown during a commercial break, ft / The system of the invention may be Used to iselect; 
will be appreciated that the subject matter of the television appropriate advertisements based at least in part on whether 
program may be identified using the descriptions in the the video programming feed is watched as it is broadcast or D 
electronic program database 81, by monitoring the contents being replayed from recorded media. Certain advertisements 
of the closed captioning information, or by any other desired; 5 have time-sensitive subject matter, such as those that present 4py 
method. commercial offers for a limited time. Advertisers can update - 
The ad selection criteria may further be used to choose time-sensitive advertisements when such advertisements «+- 
advertisements that are compatible with television viewing havc been rcC orded, so as not to present obsolete informa- P'v**fc 
habits of the viewer, the preferred Internet or World Wide tion t0 mc vicwcr Furthermore, according to the methods of 
Web sites, previous Internet purchases made using the home w ^ mvCQtkm advertisements originally recorded on video- 
entertainment system, responses to consumer habits and 0f recordcd medium cm bc n lacc(J ^ 

preferences surveys and the like In addition, advertise- effectively targeted ads based on any other desired criteria. . 

ments can be selected in response to the viewing habits or a m „ t , , 

viewer with respect to advertisements in general. For J The ad select 1 i on criteria may further be used to choose 

example, many viewers habitually change the television „ advertisements based on the content of recently displayed 

channel whenever an advertisement is shown. Such aggres- 15 advertisements. For example, an advertiser for one car 

sive "channel surfers" are often able to avoid a large manufacturer may want to preclude advertisements from 

percentage of advertisements simply by tuning into channels other automobile manufacturers. Alternatively, an advertiser 

that are broadcasting programming. In response to channel m A a y ™*J° ^P 1 ^ an advertisement to a viewer directly 

surfers, the invention may be adapted in one of several ways. 9n f er an advertisement of a competitor in order to highlight 

In a first example, video switch 90 of FIG. 5 inserts one 20 * e c u om P et ^ ve advantages of its goods or services. Such 

particular advertisement into each advertisement slot that the flexibility allows advertisers to display their advertisements 

channel surfer encounters as he or she progresses through a ! a tune mat 15 ^ to P rovide the S reatest in * act 0B the 

the channel lineup. In this way, the channel surfer is repeat- viewer. 

edly exposed to at least bits and pieces of the one particular The ad selection criteria may be set or modified by the 
advertisement. Eventually, given enough time and channel viewer, as weU, in order to request or block advertisements 
changes, the commercial message of the particular adver- f° r selected classes of goods or services. This optional 
tisement is communicated to the channel surfer. feature of the invention advantageously allows the viewer to 
In a second example, the video programming broadcast to participate in a selection of advertisements. In an extreme 
the home entertainment system from multiple content pro- 30 case > tne ad selection criteria 83 may be modified in 
viders or television channels is coordinated so that each response to, for example, increased subscription fees from 
channel simultaneously broadcasts advertisement slots. In me ^cwer in order to allow the viewer to forego advertise- 
this example, a selected advertisement is displayed simul- ments altogether. In this case, advertisements may be 
taneously on all of the multiple channels, so the advertiser replaced by entertainment, informational, or any other pro- 
ensures that instant coverage is made to viewers watching 35 g rammin S- 

any of a large number of channels. Such "blanket saturation" Advertisement selection may further be conducted 

is effective, not only to reach channel surfers, but also to according to the identified viewer demographic information, 

reliably target any desired segment of the viewing popula- Certain goods or services may appeal primarily to either 

tion. rnen or women, to certain age groups, or persons of certain 

In one embodiment, statistics collection location 61 of 40 income levels. Accordingly, advertisers using the methods 

FIG. 5 counts the number of times a particular viewer has disclosed herein are able to reliably identify members of the 

seen a selected advertisement. Once the advertisement has desired segment of the viewing population according to the 

been displayed the desired number of times during a given demographic information stored in storage location 82. It 

time period, further display of the advertisement to the can be understood mat using specific mformation relating to 

viewer is blocked. This is useful, for example, to prevent 4S mc viewers in a household is significantly more efficient 

viewers from becoming frustrated through being excessively maD relying on estimated or average demographic charac- 

exposed to the selected advertisement. teristics of viewers of individual programs and program 

Hie ad selection criteria 83 could be used to select types, 

advertisements having different content ratings depending The ad selection criteria 83 further have the capability of 

on the content rating of the program being watched by the 50 targeting advertisements to narrowly defined geographical 

viewer. Alternatively, the content rating of the selected areas. Accordingly, advertisers may direct their advertise- 

advertisement may be coordinated with parental lock codes ments only to viewers living in selected streets, 

or other indications of preferred or permissible program- neighborhoods, cities, or the like. According to further 

ming content stored in the home entertainment system. alternative ad selection criteria, advertisers may pay for a 

Content rating selection may be used to choose between 55 guaranteed number of exposures. In yet another variation, 

different versions of an advertisement for one product, one advertisements are displayed in a small number of 

example being an Rrated and a PG-rated trailer for a motion households, while detailed viewer response information is 

picture. gathered in a focus group-type arrangement. 

Local time may be used to select an appropriate adver- In view of the foregoing, those of skill in the art will 

tisement in situations where a program is broadcast simul- 60 understand that many other ad selection criteria or viewer 

taneously to viewers in different time zones. For examples, and system information may be used to effectively select 

satellite television subscribers on the West Coast often have appropriate advertisements. The specific examples disclosed 

access to the East Coast feeds of national broadcasters and above are not to limit the scope of the invention, but serve 

cable networks. Accordingly, the ad selection criteria could instead to illustrate suitable and presently preferred embodi- 

ensure that certain advertisements are shown at the time of 65 ments of the invention. 

day desired by the advertiser (i.e., showing "latenite" ads vs. Returning to the embodiment shown in FIG. 5, the ad 

"primetime" ads). insertion device 80 includes means for receiving an adver- 
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tisement stream, including a plurality of advertisements. a virtual advertisement storage system, whereby advertise - 

One example of such means includes telephone lines. In merits are delivered to the ad insertion device, selected, and 

many cases, the telephone line connected to ad insertion displayed "on the fly" without any actual intermediate 

device 80 is a shared line that also provides conventional storage of the advertisements in the ad insertion device. This 

residential telephone service to the household. Ad insertion 5 me thod of "streaming" advertisement data is useful in home 

device 80 initiates a telephone call on a periodic basis to an entertainment systems having small or no hard drive or other 

advertisement source to request a download of advertise- data storagc devices. According to the streaming method, a 

ments. When the telephone line connected to ad insertion yideo programming strcam ^ multiplexed with one or more 

dcV 2* ^ \ shared u hne > the Innate calls are preferably advcrtisemcnt strcams , thereby providing a periodic or con-' 

conducted durmg he mghttoe hours ^ stream f advcrtisemcnts , of which te 

day when the likelihood of conflict with residential use of i * j jj-i j * *u • • i *• t-l 

the telephone hue is reduced. Alternatively, the means for scl ^ d ™L displayed to the viewer in real-time^ The 

receiving the advertisement stream may include any other multiplexing method can be in-band by splitting a digital 

advertisement delivery channel, such as an over-the-air strcam mto multiple lower bandwidth streams and distnb- 

broadcast, a cable provider, a consumer satellite service, a utm S the Vldc0 Programming stream and the advertisement 

data transport, such as an Internet connection, or any other 15 streams among the lower bandwidth streams. Alternately, 

system for transmitting video data. me multiplexing method can be out-of-band, in which 

FIG. 5 illustrates an optional ad filter device 84 used to multiple channels, including a video programming channel 

pre-screen and accept only selected advertisements from the and one or more advertisement channels, are simultaneously 

ad delivery source. Such a prefiltering process is useful transmitted. 

when an advertisement repository 86 is capable of storing a 20 The video switch 90 selects between a real-time video 

limited number of advertisements. The advertisements are programming feed and a real-time advertisement feed. In 

filtered by ad filter device 84 according to the ad selection one example of this approach, the advertisement delivery 

criteria stored at storage location 83. channel delivers, in real time, two or more advertisements 

Advertisement repository 86 contains a cache of delivered; synchronized to start in unison with the beginning of the 

advertisements that optionally have been prefiltered; 25 advertisement time slot in the video programming feed. 

Accordingly, advertisement repository 86 is but one Another embodiment may have very limited ad storage 

example of means for storing a plurality of advertisements; capability, perhaps two or three ads for each time slot, and 

Advertisement repository 86 may comprise any computer receiye ^ ads encoded [n ^ 5roadcast si . just before 

4o readable medium capable of storing digitally encoded video selection and display, 

ci «. — programming and later making the encoded programming 30 ^ 

available for display to a viewer. Alternatively, advertise- In 7 et another embodiment, advertisements are selected/ 

ment repository 86 may comprise conventional magnetic md inserted into a video programming stream without 

video tape or another recording medium for storing anl to the position of the conventional advertising slot, 

analog version of the video programming feed. 0 Instead of an appropriate time determined by the content of w ^ 

Ad insertion device 80 includes means for detecting a 35 ^ P"*"™? or b ? an y otl f r desired crite ™> *f ^ U*>fc 

triggering event indicating an appropriate time to display the Programming a interrupted and one or more selected adver- 

selected advertisement. One example of such means Use 1 m ^ ts '™ ^P 1 ^ ln tms embodiment a delay code is 

includes a switching decision unit 88 that monitors a trigger ^bedded m the video programming, which functions to 

delivery channel in order to identify the triggering event. d f a ? or P ause ^ e P^amming during the length of the 

However, the means for detecting a triggering event may 40 advertisements. Once the adverusements are completed the 

instead include computer-executable instructions carried on P aused programmmg resumes. From the standpoint of the 

a computer-readable medium for analyzing the structure of ™ r > ^ ad be ™ dlffe rent man the 

a video programming feed and identifying a virtual trigger- other embodiments of the invention, 

ing event as described herein. In one implementation, the ad delivery of FIG. 5 is 

As discussed above with respect to FIG. 4, the triggering 45 ^ducted by transmitting the advertisements on a piece- 
delivery channel may be combined with the delivery of the meal basis during transmission of a typical analog television 
video programming feed. In one embodiment the triggering broadcast The advertisements can be received by advertise- 
signal is transmitted during the vertical blanking interval ment repository 86 during the vertical blanking intervals of 
(VBI) of a television signal. The triggering signal may be me television signal. In this manner, the advertisements can * 
encoded in the broadcast by a content provider that has 50 be transmitted without an increase in bandwidth or the use n* n 5 
agreed to cooperate in the ad insertion system of the inven- of dedicated delivery channels. In view of the foregoing and 
tion. Because the triggering signal appears in the video me omer memo disclosed herem, it can be understood that 
progra mmin g f ee d at a pre- identified or otherwise deter- me delivery may be a real-time feed, a relatively slow and 
.mined period of time before the onset of a subsequent . ongoing process, a download of a relatively large number of 
advertisement series, the ad insertion device 80 may thereby 55 advertisements durmg a short period, or any intermediate 
determine the precise time for inserting a selected adver- combination of the foregoing. 

tisement. When switching decision unit 88 identifies the In another alternative embodiment, the ad insertion device 

presence of a triggering signal, whether actual or implied, it permits the viewer to insert a '"bookmark" in an advertise - 

prompts video switch 90 to interrupt display of the video ment of interest. Inserting a bookmark involves saving all or 

programming feed and to insert in its place the selected 60 selected information of the advertisement for later retrieval 

advertisement from advertisement repository 86. Video or reference. A bookmark corresponding to an advertisement 

switch 90 is but one example of means for interrupting of interest may be saved in advertisement repository 86 or in 

delivery of the video programming feed and delivering, at another storage site in the ad insertion device or the home 

the appropriate time, the selected advertisement to the entertainment system. 

display device. 65 In yet another embodiment, two or more appropriate 

In an alternative embodiment of ad insertion devices of advertisements are selected for an available time slot in the 

the invention, advertisement repository 86 is replaced with video programming feed. Each of the two or more selected 
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advertisements is displayed at the appropriate time using a tisement stream 64 to a receiver unit 138 at household 56. Id 

split-screen or another arrangement by which the viewer this manner, the system of FIG. 7 allows video programming 

may see both advertisements. The viewer then has the option and an advertisement stream to reach household 56. 

of choosing one of the displayed advertisements that is of Thereafter, ad insertion device 60 is used to select and 

greatest interest. A default or machine -selected ad can be 5 display advertisements on display device 58 according to the 

displayed if no selection is made. This method of displaying methods disclosed herein. 

multiple advertisements gives the viewer an increased I* °ne implementation, ad source 62 transmits advertise- 

degree of interactivity with respect to the selection of the ment streams 64 only periodically over satellite 134, in 

advertisements which case, a device such as advertisement repository 86 of 

, . „ , A .„ A 4 . , * j * . m FIG. 5 may be used to store the transmitted advertisements 

FIG. 6 is a now chart illustrating selected steps in one 10 - , . \ .. j j* i r? i j ^* * 

... A . . , . ^. j^- * for later selection and display. For example, advertisement 

embodiment of a method for lnserting.an advertisement into . £A j » j j- * j u i j * 

. j ■ « j • lL j- j • on stream 64 may be broadcast on a dedicated channel during 

a video programming feed using the ad insertion device 80 , . ■ L * ■ j u 1 *■ i r * 

^ x . j i j- r j * . a late night period of tune when relatively few viewers are 

of FIG. 5. Instep 100, the downloading of advertisements is . u- . i • • r\ +• n u - a- u j * 

A ' . i( _ . j. . , . . rc watching television. Optionally, when a penodic broadcast 

initiated according to the methods disclosed herein. If, k . . ° . , f , 4 f ✓ , , 

^ t ^ P " £u . . j . * • j i < technique is employed, advertisement stream 64 may be 

according to decision box 102, prenltenng is desired in order 15 , , n . \ * JU 4 . 1U j , 

, f i • j li r- * t • *u broadcast on the same channel used by national broadcaster 
to select only certain advertisement for storage in the . 0 , , , - A , . . , J * .* , 
, J . a j . j . t . 4 . 18 or cable network 30, but at an hour when the national 
advertisement repository 86, the ad selection cntena are , , . . , ' , . . aiL . A , 
j. £1. .l j ^- . • . ~t t\A t * *i_ broadcaster or cable networkis otherwise on the air. Accord- 
used to filter the advertisements in step 104. In step 106, the . . l4 , , , . iC , 
j i j j j — * ■ . u *u «n j / mg to yet another alternative, national broadcaster 18 and 
downloaded advertisements, whether prefiltered or not, are ? , J . . - n • , l4 . , , . . 

. . . . ■» on cable network 30 may choose to multiplex advertisement 

stored in advertisement repository 86. 20 . r . . . ' ~ + ~ 0 , ~ ft 

r ' stream 64 into video programming feeds 38 and 39. 

At a time selected by the viewer, the home entertainment Furthermore, the satellite service provider 130 may instead 

system in step 108 receives video programming from a be uscd to broadcast only video programming feeds 38 and 

content provider and displays the video programming. In 39 while another system is used to deliver advertisement 

step 110, a stored advertisement is selected according to the stream 64 to household 56. For example, the system of FIG. 

selection criteria as described herein. In step 112, the ad 7 may bc modified by delivering advertisement stream 

insertion device waits for a triggering event that indicates an 0 ver-the-air, by telephone lines, or by any other technique 

appropriate time to insert the selected advertisement. When disclosed herein 

a triggering event is received according to decision box 114, Wmle ^ has been described herein prirDa rily 
the video switch is activated in step 1 16, thereby interrupt- m fefercnce to inscrti advcrtiseinentSj it is to be under- 
ing the display of the video programming feed and display- stood ^ ^ mvcntion ^ not ^ited to advertisements, but 
mg the selected advertisement. mstead extends tQ mserting ^ desired type of video 
In an optional step, the viewer response to the displayed programming or other video objects into a video program- 
advertisement is monitored in step 118 according to the mmg stream. For example, ad source 62 of FIG. 4 may 
methods disclosed herein. When the selected advertisement 35 instead be a source of any desired video programming, such 
is complete, me video switch resumes transmitting the video ^ pa y-per-view, subscription, special-interest television 
programming feed to the display device in step 120. Accord- programming, video Internet broadcasts, and the like, 
ing to decision box 122, depending on the availability of FIG. 8 illustrates a further embodiment of the invention, 
more advertisements and whether the viewer chooses to m wn ich a "cross-over" link, such as an active Internet link, 
continue watching the video programming fee, the ad inser- ^ ^ embedded, inserted, or overlaid on video programming. In 
tion device either selects a new advertisement in step 110 or particular, a content provider 50 encodes cross-over links, 
the method proceeds to its close. If no more advertisements including an information retrieval address, in a video pro- 
are to be shown, the compiled viewer response statistics are gramrflmg feed 52 . According to one embodiment for encod- 
optionally reported m step 124 to the operator of the mg cross-over links, content provider 50 includes a pro- 
advertisement source or to a third party. If viewer response 45 grammmg source 66 and a programming database 140 that 
statisucs are to be reported, they may be transmitted from mc ludes information relating to the program description, or 
the ad insertion device at any convenient time. Step 124 can topics ^ persons, brand names, etc., that appear in the 
be performed on a periodic basis, such as once per day or video programming feed 52. Programming database 140 is 
once per week- associated with an Internet database 142 or a database 
FIG. 7 illustrates a further embodiment of the invention, so associated with another information service. Internet data- 
wherein the video programming and, optionally, the adver- base 142, includes, for example, selected Internet sites that 
tisements to be inserted in the video programming, are pertain to any of a wide variety of topics and subjects, 
delivered by means of a satellite broadcast system. It is well Internet database 142 and programming database 140 can be 
known in the art that satellite service providers may be used to identify and select Internet sites that relate to the 
advantageously used to deliver video programming to ss video programming feed 52 according to desired rules and 
viewers, and are thus an alternative to cable providers, parameters. When a selected topic or subject is being 
over-the-air broadcasts, and other broadcasting methods. In broadcast in video programming feed 52, an information 
FIG. 7, national broadcaster 18 and cable network 30 make retrieval address corresponding to one or more related 
their programming feeds 38 and 39 available to satellite Internet sites is encoded in the video programming feed by, 
service provider 130, which men uplinks ail analog or digital 60 for example, cross-over link encoder 144. In one 
data stream 132 to satellite 134. Advertisements 20 and 34 implementation, an Internet address is encoded in the video 
are typically included in advertisement slots in the program- programming feed 52 during the vertical blanking interval, 
ming feeds 38 and 39. Video programming feed 52, including the encoded cross- 
According to the invention, an ad source 62 provides an over link, is delivered to household 56 according to any 
advertisement stream 64, which is also transmitted by sat- 65 desired method. A cross-over link decoder 146 extracts the 
ellite service provider 130. Satellite 134 transmits signals cross-over link information from video programming feed 
136 that include programming feeds 38 and 39 and adver- 52. WebTV boxes are one example of devices that support 
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link decoding. The decoded cross-over link 148 may then be 
displayed on display device 58. For example, cross-over 
links 148 may be displayed by overlaying the link on a 
conventional television display, by generating a split-screen 
display, or by any other desired method. Cross-over link 148 
is thus a visually displayed object that offers the viewer 
access to further information relating to the topic or subject 
that is simultaneously displayed on the video programming 
of display device 58. 

A viewer is then permitted to select the cross-over link 
148 by use of a remote control device or another input 
device 150. Selection of cross-over link 148 initiates a 
request to an Internet service provider 152 or another 
information service provider for retrieval of the information, 
such as a World Wide Web page, associated with the selected 
cross-over link. The selected information is retrieved by 
Internet service provider 152 and is delivered to household 
56 via an information delivery channel for display on 
display device 58. The retrieved information may be dis- 
played by interrupting the video programming feed and 
inserting the information on display device 58, by generat- 
ing nested display windows so as to avoid interrupting the 
video programming, or by any other desired method. 

The invention also extends to methods for collecting and 
reporting viewer response information. For example, regard- 
less of the advertisement selection rules and criteria, actions 
taken by viewers in response to particular advertisements 
may be collected at statistics collection location 61 or 
another suitable device and periodically reported to the 
advertiser, the ad source, or another party. It is to be 
understood that such methods of collecting and reporting 
viewer response information is encompassed by the inven- 
tion. 

Hie present invention may be embodied in other specific 
forms without departing from its spirit or essential charac- 
teristics. The described embodiments are to be considered in 
all respects only as illustrative and not restrictive. The scope 
of the invention is, therefore, indicated by the appended 
claims rather than by the foregoing description. All changes 
which come within the meaning and range of equivalency of 40 
the claims are to be embraced within their scope. 

What is claimed and desired to be secured by United 
States Letters Patent is: 

1. In a household home entertainment system comprised 
of a display device for receiving and displaying video 45 
programming received from a video content provider, and a 
computing system for controlling at selected times the 
source of the video content to be displayed, and particularly 
the source and nature of advertising content, a method for 
controlling and determining locally at the home entertain- 50 
ment system the advertising content to be displayed from 
time to time for one or more users of the home entertainment 
system when viewing video programming received from a 
video content provider, the method comprising steps for: 
storing at the computing system criteria for selecting 55 
some advertising content and not other, the criteria 
being based on factors provided from any one or any 
combination of i) a user profile for one of the one or 
more users viewing the video programming, ii) a video 
programming content provider, iii) a third party eo 
operator, and iv) an advertiser; 
receiving at the home entertainment system advertising 
content from an ad source, and subsequently deciding 
whether to prefilter at least some of the received 
advertising content using the stored criteria, and there- 
after storing at the computing system any received and 
prefiltered advertising content; 
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receiving and displaying at the display device video 
programming provided by a video content provider; 
and 

using the stored criteria, and while the video program- 
ming is being displayed, the computing system detect- 
ing a predefined triggering event, and then selecting 
advertising content to be displayed and displaying it by 
performing one or both of i) inserting from advertising 
content stored locally at the computing system at least 
some of the selected advertising content into the video 
programming being displayed, and ii) using the stored 
criteria at the computing system, screening advertising 
content included with the video programming to dis- 
play some but less than all of the included advertising 
content 

2. In a household home entertainment system comprised 
of a display device for receiving and displaying video 
programming received from a video content provider, and a 
computing system for controlling at selected times the 
source of the video content to be displayed, and particularly 
the source and nature of advertising content, a computer 
program product comprising a computer readable medium 
for carrying executable instructions for implementing a 
method for controlling and determining locally at the home 
entertainment system the advertising content to be displayed 
from time to time for one or more users of the home 
entertainment system when viewing video programming 
received from a video content provider, and wherein the 
method is comprised of steps for: 

storing at the computing system criteria for selecting 
some advertising content and not other, the criteria 
being based on factors provided from any one or any 
combination of i) a user profile for one of the one or 
more users viewing the video programming, ii) a video 
programming content provider, iii) a third party 
operator, and iv) an advertiser; 

receiving at the home entertainment system advertising 
content from an ad source, and subsequently deciding ~ 
whether to prefilter at least some of the received 
advertising content using the stored criteria, and there- 
after storing at the computing system any received and 
prefiltered advertising content; 

receiving and displaying at the display device video 
programming provided by a video content provider; 
and 

using the stored criteria, and while the video program- 
ming is being displayed, the computing system detect- 
ing a predefined triggering event, and then selecting 
advertising content to be displayed and displaying it by 
performing one or both of i) inserting from advertising 
content stored locally at the computing system at least 
some of the selected advertising content into the video 
programming being displayed, and ii) using the stored 
criteria at the computing system, screening advertising 
content included with the video programming to dis- 
play some but less than all of the included advertising 
content. 

3. A method as recited in claims 1 or 2, further comprising 
the step for monitoring the video programming in order to 
detect a triggering signal, wherein detection of the pre- 
defined triggering signal is the triggering event. 

4. A method as recited in claims 1 or a wherein the 
triggering event is derived from the structure of a video 
programming feed used for providing the video program- 
ming. 

5. A method as recited in claims 1 or 2, wherein the 
criteria based on factors provided from said user profile 
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further comprises a step for compiling and storing household 
data characterizing the home entertainment system. 

6. A method as recited in claims 1 or 2, further comprising 
a step for identifying a television program being carried on 
said video programming, and wherein the stored criteria 
provides that a specific advertisement is to be selected for 
display during said identified television program, indepen- 
dent of any particular television channel on which said 
identified television program is broadcast. 

7. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of monitoring closed captioning 
information of the video programming being displayed in 
order to identify subject matter of the video programming, 
so that an appropriate advertisement is to be selected for 
display based at least in part on the identified subject matter. 

8. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of compiling demographic data 
characterizing a viewer of the displayed video programming 
feed, so that an appropriate advertisement is to be selected 
for display based at least in part on the compiled demo- 
graphic data. 

9. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of compiling geographical data 
specifying the geographical location of the home entertain- 
ment system, so that an appropriate advertisement is to be 
selected for display based at least in part on the geographical 
location. 

10. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of compiling data characterizing 
the habits of a viewer of the video programming relative to 
the features of the home entertainment system, so that an 
appropriate advertisement is to be selected for display based 
at least in part on the habits of the viewer. 

11. A method as recited in claim 10, wherein the habits of 
the viewer include at least one of the types of video 
programming watched by the viewer, the types of Internet 
sites visited by the viewer, and purchases made by the 
viewer through the Internet. 

12. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of presenting a survey including 
one or more inquiries to a viewer of the video programming, 
so that an appropriate advertisement is to be selected for 
display based at least in part on responses of the viewer to 
the survey. 

13. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of detecting a content rating 
associated with the video programming, so that an appro- 
priate advertisement is to be selected for display based at 
least in part on the content rating. 

14. A method as recited in claims 1 or 2, wherein one of 
said factors is comprised of identifying a parental lock code 
entered to the home entertainment system, so that an appro- 



)8,020 Bl 

22 

priate advertisement is to be selected for display based at 
least in part on the parental lock code. 

15. A method as recited in claims 1 or 2, wherein the step 
of displaying the video programming comprises the step of 

5 transmitting the video programming from a video recording 
media located at the home entertainment system, and 
wherein one of said factors is comprised of the recorded 
nature of the video programming. 

16. A method as recited in claims 1 or 2, wherein one of 
10 said factors is comprised of compiling information relating 

to the actions that a viewer of the video programming feed 
has taken in response to previous displayed advertisements, 
so that an appropriate advertisement is to be selected for 
15 display based at least in part on the compiled information. 

17. A method as recited in claims 1 or 2, further com- 
prising the step of storing information contained in the 
displayed advertising content for later reference in response 
to actions of a viewer of the displayed advertising content. 

20 18. A method as recited in claims 1 or 2, wherein said 
selected advertising content is comprised of a first and a 
second advertisement which are simultaneously displayed in 
a split-screen format on the display device. 

19. A method as recited in claims 1 or 2, further 
25 comprising, either during or after display of said selected 

advertising content, a step for collecting information about 
actions of a viewer of said selected advertisement, including 
at least one of either channel changes during display of said 
selected advertisement, requests by said viewer for addi- 
30 tional information, or feedback provided by said viewer in 
response to said selected advertisement. 

20. A method as recited in claims 1 or 2, further com- 
prising a step for learning the identity of the viewer by 
requesting that a viewer log on to the home entertainment 

35 system before displaying the video programming, and 
wherein one of said factors is comprised of the identity of 
the viewer. 

21. A method as recited in claims 1 or 2, wherein the 
selected advertising content comprises one or more 

40 computer-generated documents. 

22. A method as recited in claims 1 or 2, further com- 
prising a step for monitoring a cumulative number of times 
that one or more advertisements of the selected advertising 
content has been displayed at the home entertainment 

45 system, and wherein one of said factors is comprised of the 
cumulative number. 

23. Amethod as recited in claims 1 or 2, wherein the video 
programming and the selected advertising content are mul- 
tiplexed and delivered to the home entertainment system in 

50 a single data stream. 

***** 
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